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Abstract 

A network growth mechanism based on a two-step preferential rule is investigated 
as a model of network growth in which no global knowledge of the network is 
required. In the first filtering step a subset of fixed size m of existing nodes is 
randomly chosen. In the second step the preferential rule of attachment is applied 
to the chosen subset. The characteristics of thus formed networks are explored 
using two approaches: computer simulations of network growth and a theoretical 
description based on a master equation. The results of the two approaches are 
in excellent agreement. Special emphasis is put on the investigation of the node 
degree probability distribution. It is found that the tail of the distribution has the 
exponential form given by exp(—k/m). Implications of the node degree distribution 
with such tail characteristics are briefly discussed. 
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1 Introduction 



In many aspects of the society and the world we live in, network structures 
are a common occurrence. At the level of their phenomenological description, 
these networks are very heterogeneous both in the nature of their nodes and 
their links and, apart from their very network nature, seemingly have nothing 
in common. However, more detailed statistical analysis of various communi- 
cation, transport, social, biological and other networks have revealed amazing 
similarities in their statistical characteristics. These findings, implying the ex- 
istence of a general underlying organizing principle, have stimulated an entirely 
new wave of research and have given birth to the field of complex networks 
[1,2,3,4]. 

The statistical characteristic of complex networks that proved to be the most 
suitable for demonstrating the common features of very different networks is 
the distribution of node degrees. It was found that in complex networks as dif- 
ferent as Internet [5], world wide web [6], citations [7], scientific collaborations 
[8], metabolic interactions [9] and many others, the distribution of degrees 
has a power law character for large values of node degrees, i.e. a power law 
tail. This property of the aforementioned networks, which are also referred 
to as scale-free networks, was shown to be important in dynamical processes 
on networks, such as human epidemics and e-mail virus spreading [10,11] and 
resilience to Internet attacks [12,13]. A deeper understanding and modeling of 
laws behind the formation of scale-free networks was clearly necessary. 
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The first crucial step towards unraveling the principles behind "scale-free" net- 
works was undertaken by Barabasi and Albert [14]. Their model (in further 
text referred to as BA model) is founded on two simple, but essential princi- 
ples [15]: network growth and preferential attachment. The network growth is 
realized by adding a new node to the network at each time step. The new node 
attaches to r already existing nodes in the network. The rule of preferential 
attachment dictates that the probability of attaching a new node to the ex- 
isting node is proportional to the degree of the existing node. These two basic 
principles are sufficient to reproduce a power law tail. A host of modifications 
and elaborations of the preferential attachment rule in the evolving networks 
followed very soon after the formulation of the BA model [16,17,18,19]. These 
models succeeded in reproducing some of the statistical characteristics of com- 
plex networks, such as the power law exponent, in a more realistic manner. 

Apart from the preferential attachment rule, it is possible to question how 
other elements of the BA model could be modified to better capture the prop- 
erties of real world networks. In the process of adding a new node to a very 
large network (such as www) , it is reasonable to expect that only part of infor- 
mation about the entire network is effectively available. Such an assumption is 
grounded in the fact that nodes usually have a limited processing capability or 
have (e.g. topical) interest only in a part of the network. It is also reasonable 
to expect that within the processed part of the network the attachment rule 
of the new node to the old ones is not completely random, but is preferen- 
tial. Namely, some of the old nodes are more "appealing" to the new ones. 
A reasonable variant which encompasses the aforementioned properties is the 
filtration of global information [20]. In this model of network growth, a new 
node selects a subset of existing nodes and then applies the rule of preferential 
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attachment to the selected subset. The principle of selection may be chosen 
in various ways. The subset may be formed by randomly choosing a finite 
fraction or a fixed number of existing nodes [20]. In the case of the choice 
of the finite fraction, however, the selected subset may become unrealistically 
large for large networks and moderate fractions. One can also introduce an 
additional attribute of every node, and select into the subset only those ex- 
isting nodes the attributes of which are sufficiently similar to the attribute of 
the new node [21]. This model may, e.g. simulate the attachment to topically 
similar pages on the www. 

The investigation of the model of preferential attachment based on the re- 
alistic access to the information on the network structure is also important 
with respect to the properties of dynamical processes on networks. It has 
been shown [10] that in scale-free networks there exists no threshold for the 
spreading of epidemics in human society or computer viruses in the Internet. 
The key feature for the nonexistence of the epidemics spreading threshold (or 
equivalently, lack of the phase transition) is the power law tail of the node 
degree distribution in scale-free networks. In the realistic modifications of in- 
formation filtering it is reasonable to expect that some of the characteristics 
of the node degree distribution might change. One of the aims of this paper 
is to determine the behavior of the node degree distribution function for large 
degrees and its consequences for the dynamical processes on networks formed 
by information filtering. 

In this paper, we study a particular model of information filtering with special 
emphasis on its theoretical description and tail characteristics. In this model, 
already introduced in [20], a selected subset, which we call the filtration subset, 
is formed by randomly choosing a fixed number of existing nodes. We concen- 
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trate on the determination of the node degree distribution and approach the 
problem in two different ways: theoretically, applying the master equation ap- 
proach of Dorogovtsev and Mendes [23] and using computer simulations, in a 
manner analogous to [20]. The results of these two approaches are compared 
and their agreement discussed in detail. 



2 Model 



We start with the discussion of computer simulations of the network growth 
in our model. The network grows by addition of one new node at each time 
step. Each new node connects to the existing network with one link. This 
special choice facilitates the theoretical treatment and ensures a higher level 
of analytical tractability. Therefore, at the time step t, there are t links in 
the network. In every simulation of the network growth, a core of the network 
is initially formed. The core of the network is formed in a growth procedure 
where each new node is randomly connected to one of the existing nodes. The 
size of the network core is chosen to be larger than the maximal size of the fil- 
tration subset that is considered in this paper. As we consider filtration subset 
sizes up to 1000, the network core size is taken to be 1100 in all simulations. 
The nodes are numbered starting from 0, and the network is allowed to grow 
until the number of nodes, and respectively the number of links, reaches the 
maximal value n max , which is generally taken as n max = 10 6 . The statistical 
descriptors of the investigated network are obtained as averages over 100 inde- 
pendent realizations of the network topology. The stability of the node degree 
probability distribution was tested by varying the final network size from 10 5 
to 10 7 . The simulations with different values of n max show the stability of the 
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node degree probability distribution for all but the largest node degrees. The 
probability distributions are characterized by the exponential cut-off in the 
tail. For larger n max , the position of the cut-off is shifted more towards larger 
node degrees, as already found in [20] . The stability issues will further be ad- 
dressed in section 4. It has also been found that the node degree probability 
distribution does not depend in any significant way on the choice of the core 
of the simulated network. The results of simulations are displayed in Fig. A.I. 
The cumulative probability distribution clearly exhibits the power law scaling 
for a broad range of node degrees and has a rapidly falling tail. The exponent 
of the power law behavior of the cumulative probability distribution is close 
to -2. 

3 Theoretical treatment 

In the theoretical treatment of the node degree distributions we adopt the 
master equation approach of [23] 

In the type of the growing network investigated in this paper, each node is 
uniquely identified by the time of its attachment to the network which is 
hereafter denoted by s. In such a framework, we introduce the probability 
that a node created at time s, at some time t, where t > s, has the degree 
k and denote it as p(k,s,t). The probability that a randomly chosen node 
has a degree k at time t is denoted by P(k,t). The cumulative probability 
distribution is denoted by P cum (k,t) and defined as P cum (k,t) = X^ fc -P(M)- 
The quantity of interest in our theoretical approach is the probability that the 
node added at time t attaches to the node created at time s which at that 
time has the degree k. The size of the filtration subset is m. The probability 
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that the chosen filtration subset at time t contains the node created at s with 
the degree k and that the sum of degrees of all nodes in the subset equals I is 



t 



w(l — k, m, t) = 



m — 1 



g(l-k,t) 



( \ 

t 



m 
\ J 



where g(u, t) is the probability that the sum of degrees of m — 1 nodes is u at 
time t. It is obtained as a convolution of the order m — 1 of the probability 
function P(k, t — 1), i.e. 



g{u,t) = P< m - x \u,t-\). 



(2) 



The expression (2) allows us to write equation (1) as 



w(l - k, m, t) = jP*( m -V (I - k, t - 1) . 



(3) 



This probability of choosing the desired node in a selected filtration subset 
must be multiplied by the probability of choosing the node created at time 
s from the selected filtration set. This phase of selection is preferential, i.e. 
the probability for any node being chosen is proportional to its degree. For 
the selected subset described above, this probability amounts to k/l. With all 
necessary elements specified, we can formulate the master equation for the 
probabilities p(k, s, t): 



P(k,s,t)=[ w(l- (k-l),m,t)- 

i l=k— 1+m— 1 



/ 
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xp(k - l,s,t - 1) 
+ 11 



k 



w(l-k,m,t)- 

k+m-l 1 



xp(k,s,t-l), 



(4) 



for k > 2 and 

1- X! w(/-l,m,t)yj 
xp(l,s,f-l). (5) 



The limits of summation take into account the fact that the minimal degree of 
any node in the network is 1. The term in the upper limit of the summations, 
denoted by a max , specifies the maximal value the sum of m — 1 degrees can 
have. In the limit of infinitely large networks, it becomes infinite. Performing 
index substitutions in the summations on the right-hand side of (4) and (5) 
and using (3), we obtain 

x - 1, s,t - 1) 

xp(fc,s,t-l) (6) 



and 



a p*("»-l)( r * _ 1) 



r=m—l 



r + 1 



xp(l,s,t-l) 



(7) 
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The probability function for the node degree can be further defined in terms 
of the probability p(k, s, t) as 

p(M) = t^-S>(*,M)- (8) 



Furthermore, we introduce a function 

a m ax p*(m—l)( r . j- 1 \ 

Mk,t) = m E ri — ( ) 

r=m-l r + K 



which, together with (8), leads to the recursive relations for the node degree 
probability function: 



P(k, t) = k j-^j m {k - l,t)P(k - 1, t - 1) 

+ (i-*/ ra (M))^P(M-i) (io) 



and 

f(M) = ^ + (i - - t Uht)) j^P^t- i) • (ii) 

The set of equations displayed so far operates with the time-dependent proba- 
bility distributions. As the results of simulations imply, the node degree prob- 
ability distribution becomes stable when the growing network becomes large 
enough. Therefore, in further considerations we investigate the stable proba- 
bility distribution. This implies that P(k,t) — > P(k) and f m (k,t) — > f m (k). 
For the stable degree node probability distribution, we have the following re- 
lations: 

(k - l)f m (k - l)P(k - 1) 

P[k) ~ i + kf m {k) (12) 
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and 



The set of equations (12) and (13) is a complicated set of equations given the 
fact that the functions f m (k) depend on the entire probability distribution 
P(k) in a nonlinear fashion. In solving this set of equations we adopt the 
following iterative procedure. The function f m (k) is calculated using a guess 
initial node degree probability distribution of the form P(k) ~ A:" 7 with 7 = 3 
(reminiscent of the Albert-Barabasi model). The function f m (k) thus obtained, 
is further used to recursively calculate the probability distribution P(k) from 
the set of equations (12) and (13). The obtained probability distribution is 
then used to calculate the function f m (k) and the entire procedure is repeated 
until satisfactory convergence is achieved. 

4 Results 

The results of the calculations of the theoretical node degree probability dis- 
tribution show excellent agreement with the analogous results obtained in 
simulations. In Figs A. 2, A. 3, A. 4, and A. 5 we show graphs of cumulative de- 
gree node probability distributions for the values of the subset size m — 2, 10, 
100, and 1000. The agreement of the two cumulative distributions obtained by 
completely different procedures is excellent, except for the largest values of the 
node degrees. The disagreement in this area of k is attributed to the finite size 
effects of the cumulative distribution obtained by simulation. The agreement 
between the theoretical and simulational cumulative probability distribution 
is present not only for the linear parts of the graphs in the log-log plots, but 
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also for the curved ones which represent the declination from the power law 
i.e. the quickly decaying tail. This fact is especially clear for smaller values of 
the filtering subset m (see e.g. Figs A. 2 and A. 3) Therefore, the theoretical 
distribution functions are capable of explaining the characteristics of the tail 
of the cumulative probability distribution P cum (/c). These findings support the 
use of the theoretically constructed distributions as predictions of the results 
that would be obtained in the simulations of larger networks. The stability 
of the node degree probability distribution for m = 10 is shown in Fig. A. 6. 
For larger sizes of the simulated network n max , the node degree probability 
distribution approaches more to the theoretically obtained one. From the dis- 
tributions displayed in Fig. A. 6 it is natural to expect that the simulated 
and theoretical curves will be in full agreement for the infinitely large simu- 
lated network. An analogous behavior is observed for all sample sizes m. The 
disagreements in the tails of probability distributions between finite size sim- 
ulated networks and theory are attributed to the finite size of the simulated 
networks. 



Inspection of the theoretically constructed cumulative probability distribution 
shows that this distribution has a tail decreasing faster than the power law 
which dominates the appearance of the distribution for quite a large number 
of decades in k. Further inspection of these graphs in a linear-log plots re- 
veals the exponential nature of the distribution tails. Let us further examine 
characteristics of these tails. Interesting information in this direction can be 
provided by taking into consideration the function f m {k) appearing in the 
recursion relation for the probability function P{k). In Fig. A. 7 it is clearly 
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shown that 1/ f m is very linear, i.e. the form of this function is 

Uk) = TTh? • (14) 



Based on this form of dependence of f m on k, we can treat the set of equations 
(12) and (13) in a much more analytically tractable fashion. For large values of 
k it is possible to write Eq. (12) in a continuum approximation as a differential 
equation 

p ^ - -T k (toH ' (15) 

or, equivalent ly as 

7 dP(k) ( b m k \ 

k - = -r— r- -a m -b m k-l \ P(k) . (16) 

dk \a m + b m k J 

The solution of Eq. (16) is of the form 

P(k) = C{a m + b m k)k' {am+1 h- hmk , (17) 

where C is the integration constant. The cumulative probability distribution, 
obtained by the integration of expression (17), then acquires the form 

Pc Um (k) ~ k- a ™e- b ™ k . (18) 

The final result demonstrates that the tail of the distribution has the exponen- 
tial nature which is governed by the value of the coefficient b m . The value of 
the coefficient a m determines the exponent of the power law part of the cumu- 
lative probability function form. Figure A. 8, displaying the dependence of the 
coefficients a m and b m on m, shows that for m > 5, the value of the coefficient 
a m lies in the vicinity of 2, which produces the power law form analogous to 
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the original Albert-Barabasi power law. The larger the value of m, the closer 
is a m to the value 2. The coefficient b m falls with the increase of the subset 
size to. Its dependence on to is given by the regression b m = 1.0003 m ~ " 982 . 
We see that a simple formula 

b m = - (19) 
to 

describes the dependence of b rn on to very well. Let us consider this fact in 
more detail to gain further understanding of the characteristics of the function 
f m and its coefficients a m and b m . The convolution function P*^ rn ~ l \k) is a 
rather well localized distribution function, irrespectively of the (non) localized 
character of the probability distribution function P(k). This kind of behavior 
of the convolution probability function is illustrated in Fig. A. 9. The function 
f m (k) can then be written in the form 

Umax p*(m—l)( r \ 

Uk)= £ I T I - (20) 

r=m-l m ' m 

The convolution probability distribution P*( m_1 )(&;) is localized around its 
average value, amounting to (to — where fc is the average node degree in 
the network. The largest contribution to the function f m (k) comes from the 
interval around the average value of the convolution probability distribution 
P*( m ~ l \k). Assuming that the denominator in the sum of the expression does 
not vary much in the interval where the convolution probability distribution 
is non-negligible, we can approximate r in the denominator of this expression 
with (to — l)k. Now it is possible to trivially sum the terms in the numerator 
to 1 (since it is a probability function) and the expression (20) becomes 

f m (k) = —— I -. (21) 

(m-l)fc , k_ 
m m 



13 



This chain of arguments validates the expression (14) and explains its origin. It 
is interesting to note, as specified in Fig. A. 7, that the assumptions introduced 
in the preceding paragraph work satisfactorily well even for the smallest values 
of the parameter m. 

5 Conclusion 

In conclusion, we have investigated the modification of the BA model with the 
fixed size filtration subset. The node degree probability distribution was stud- 
ied using simulations of network growth and theoretical modeling. These two 
approaches yield results for the node degree probability distribution which are 
in excellent agreement. The theoretical approach enables one to gain a deeper 
insight into the characteristics of the distribution. The cumulative probability 
distribution has a power law character with an exponential tail. The power 
law exponent approaches the BA model value -2 as the filtration subset size 
m becomes larger. Furthermore, excellent agreement of the simulational and 
theoretical distributions for all node degrees except the largest, enables us 
to use theoretical distribution in gaining information on the distribution tail 
beyond information available from simulations which are constrained by the 
finite sizes of the simulational data sets. The tail decays exponentially, the 
decay being slower for the larger values of m. More precisely, the exponential 
factor is of the form e~ bmk , where b m = 1/m is a very accurate description. 
The results reported in this paper demonstrate the possible mechanism of the 
realistic access to the network information in the process of growth of the net- 
work by preferential attachment. It is clearly shown how the declination from 
the concept of the global knowledge of the network leads to the modifications 
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in the node degree probability distribution and how the exponential tail ap- 
pears. These results have interesting implications on the problem of epidemics 
spreading since the exponential tail in the node degree probability function re- 
sults in the existence of non-vanishing epidemics threshold. All other dynamic 
processes on networks that are sensitive to the (in)finiteness of the moments 
of the node degree probability distribution are affected as well. 

The modification of the preferential attachment rule considered in this paper 
is just one of the possible elaborations towards the understanding of realistic 
networks. Given the omnipresence of network structures and their large impact 
on our lives and societies, further investigations of their formation mechanism 
are called for. 

Acknowledgments. The authors would like to thank A. Siber for useful 
comments on the manuscript. This work was supported by the Ministry of 
Science and Technology of the Republic of Croatia under the contract numbers 
0098002 and 0098004. 

References 

[1] R. Albert, and Barabasi, A.-L., Rev. Mod. Phys. 74, 47-97 (2002). 

[2] Dorogovtsev, S. N. and Mendes, J. F. F., Advances in Physics 51, 1079-1187 
(2002). 

[3] M.E.J. Newman, SIAM Review 45, 167 (2003). 

[4] Watts, D. J. and Strogatz, S. H., Nature 393, 440-442 (1998). 

[5] Chen, Q., Chang, H., Govindan, R., Jamin, S., Shenker, S. J., and Willinger, 



15 



W., in Proceedings of the 21st Annual Joint Conference of the IEEE Computer 
and Communications Societies, IEEE Computer Society (2002). 

[6] Broder, A., Kumar, R., Maghoul, F., Raghavan, P., Rajagopalan, S., Stata, R., 
Tomkins, A., and Wiener, J., Computer Networks 33, 309-320 (2000). 

[7] Redner, S., Eur. Phys. J. B 4, 131-134 (1998). 

[8] Grossman, J. W. and Ion, P. D. F., Congressus Numerantium 108, 129-131 
(1995). 

[9] Jeong, H., Mason, S., Barabasi, A.-L., and Oltvai, Z. N., Nature 411, 41-42 
(2001). 

[10] Pastor-Satorras, R. and Vespignani, A., Phys. Rev. Lett. 86, 3200-3203 (2001). 

[11] Pastor-Satorras, R. and Vespignani, A., Phys. Rev. E 63, 066117 (2001). 

[12] Albert, R., Jeong, H., and Barabasi, A.-L., Nature 406, 378-382 (2000). 

[13] Cruciti, P., Latora, V., Marchiari, M., Rapisarda, A., Physica A 320, 642 (2003). 

[14] Barabasi, A.-L. and Albert, R., Science 286, 509-512 (1999). 

[15] Barabasi, A.-L., Albert, R., and Jeong, H., Physica A 272, 173-187 (1999). 

[16] Bianconi, G. and Barabasi, A.-L., Phys. Rev. Lett. 86, 5632-5635 (2001). 

[17] Bianconi, G. and Barabasi, A.-L., Europhys. Lett. 54, 436-442 (2001). 

[18] Krapivsky, P. L. and Redner, S., Phys. Rev. E 63, 066123 (2001). 

[19] Krapivsky, P. L., Redner, S., and Leyvraz, F., Phys. Rev. Lett. 85, 4629-4632 
(2000). 

[20] S. Mossa, M. Barthelemy, H.E. Stanley and L.A.N. Amaral, Phys. Rev. Lett. 
88, 138701 (2002). 

[21] J. Gomez-Gardenes, Y. Moreno, cond-mat/0401269 

16 



[22] Dorogovtsev, S. N. and Mendes, J. F. F., Europhys. Lett. 50, 1-7 (2000). 

[23] Dorogovtsev, S. N., Mendes, J. F. F., and Samukhin, A. N., Phys. Rev. Lett. 
85, 4633-4636 (2000). 

A Figures 



Fig. A.l. The node degree cumulative probability distribution obtained in the sim- 
ulations of the network growth is displayed for the values of the filtering subset 
m = 2, 20, 50, 100, 200, 500 and 1000. The cumulative probability distributions fol- 
low the power law for a range of node degrees, whereas for large values they exhibit 
a quickly decaying tail. The straight line represents the fit of the power law behavior 
with the exponent -2. 
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Fig. A. 2. The comparison of the node degree cumulative probability distributions 
obtained by simulation (circles) and theoretical calculations (full line) for m = 2. 
Theoretical and simulational distributions are in excellent agreement although the 
power law aspect of the distribution is very weakly expressed. The disagreement 
in the tail of the distributions may be attributed to the finite size effect in the 
simulational data. 




Fig. A. 3. The comparison of the node degree cumulative probability distributions 
obtained by simulation (circles) and theoretical calculations (full line) for m = 10. 
Excellent agreement of the two distributions is evident. The disagreement at the 
largest node degrees is attributed to the final size effects in the simulational distri- 
bution. 
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Fig. A. 4. The comparison of the node degree cumulative probability distributions 
obtained by simulation (circles) and theoretical calculations (full line) for m = 100. 
The two distributions are in excellent agreement, except for the largest values of 
node degrees. The disagreement in this limit is attributed to the final size of the 
simulational data set. 




Fig. A. 5. The comparison of the node degree cumulative probability distributions 
obtained by simulation (circles) and theoretical calculations (full line) for m = 1000. 
Excellent agreement of the two distributions is absent only for the largest values of 
the node degrees which is explained as a consequence of a finite data set obtained 
by simulation. 
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Fig. A. 6. The asymptotical approach of the simulated cumulative degree proba- 
bility distribution for sample size m = 10, and different maximum network sizes 
n max £ {10 5 , 10 6 , 10 7 } to the theoretically obtained one. Other sample sizes m also 
exhibit same behavior. 
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Fig. A. 7. The inverse of the function f m as the function of the node degree for the 
filtering subset sizes m = 5, 10, 50, 100, 500, and 1000. The graphs clearly show the 
linearity of functions l// m ■ 
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Fig. A. 8. The values of the coefficients a m and b m for 9 different values of m. The 
coefficient a m tends to the value 2 as m increases. The coefficient b m fits very well 
to the function 1/m as seen from the best fit function. 




Fig. A. 9. Probability distribution P*( m ~ 1 ' > (k) displayed for three values of 
m = 10, 100, and 1000. The localized character of the distributions is clearly visible 
from the graphs. 
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